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ABSTRAC? 


This paper describes an attemot to find systematic errors 
in the 12, 24 and 36-hour sea-level pressure forecasts of 
extratropical cyclogenesis producec by the operational five- 
layer primitive-equation mode. cf the Fleet Numerical Weather 
Central, Monterey, Californie. The sample of cases studied 
contained 488 cases for the :2-hour, 484 cases for the 24- 
hour, and 446 cases for the 3¢€-hour verifying times. The 
sample was extracted from the ctorm season spanning the pe- 
riod October 1971 through March 2972. Several systematic 
errors exist. They are: 1) .n underforecast of the deepen- 
ing rate in a majority of cases; 2) a tendency to greatly 
underforecast the deepening ri.te in the 12-hour prognoses and 
then to underforecast to 2 iesser Tarver or overforecast the 
meee quent 12-hour changes; °)3; a tendency to forecast the 
track co the right of the een es track; and 4) a tendency to 
forecast the 36-hour position tc the south and west of actual 
position. When compared to the National Meteorological Cen- 
ter's six-layer primitive-equation model, Fleet Numerical 
Weather Central's model showed comparable or superior per- 


formance. 
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I. INTRODUCTION AND BACKGROUND 


SincesSeptember 19/0. vice Unived Staces Fleer Numerical 


Weather Central (FNWC), Monterey, . “fornia, has fulfilled 
EMes responsibility of put aaj: a. tional numerical mete- 
opological forécasts by ~er2" 5° . five-layer, primitive- 


equation (PE), atmospher..c pzxed:zt os medel initiated by a 
Meme Cuesas by  Ps..Giyihesele acc. “2c direction of Froressors 
Gees. Haltiner and R. ie Wealieme cit the Naval Posteraduate 
Senool. Further develcve.? wet Veatinued by P. G. Kesel 
ander, J. Winninghotf ae FNWC (Kecel and Winninghoff , 1972). 
From the time of its operational implementation, the PE 
model has been subject to ccntinuing study, research, devel- 
opment and modification by Kesel, Wana Hore. Clarke and 
Others of FNWC.  Uafortu <ctely, documentation of these 
changes has not been officially published and is available 
only by personal conversation with those involved; however, 
it has been ascertained that major changes in the radiation, 
precipitation, and diffusion aspects of the model, along 
with various minor and cosmetic changes have been made in 
the continuing quest to output the best possible product. 

In mid-latitudes, significant weather is almost invari- 
ably associated with cyclonic systems. [It is therefore 
possible, to a large extent, to infer weather patterns from 
frontal-cyclone models. While it must be recognized that 


a "perfect" forecast is virtually impossible due to 
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mesoscale weather phenomenr:,. the ability to more precisely 
forecast: local weather is in direct relationship to the 
timely knowledge of the cervclJcpment and movement of the 


synoptic scale patterns 


Studies by Pawcett (19609) ,~ Leary (1971) and Iracton 
(1972) have demonstrated that systematic errors in forecast- 
ing cyclogenesis exist in che National Meteorological Center 
(NMC) six-layer PE forecast model (Shuman and Hovermale, 
1968). Until now, however, a detailed study has not been 
made to determine the existence and nature of systematic 
errors in the FNWC-PE forecasts of extratropical cyclogene- 
Sasi; —Therefore,~the user-at the local level has had to 
rely upon his own intuition, experience, and assumptions 


made from NMC-PE verifications. 
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Pia DOBIEGCIIVEVORPe IRE ys TuUDY 


The objective of tnis study is to document systematic 
errors, if any, in FNWC-PE 12-, 24- and 36-hour forecasts 


of extratropical cyclogenesis. 


iz 


Ett. SVERT PI CATION ee ROCEDURES 


At the outset of this study the fact was recognized 
that, in order ae produce the most meaningful results pos- 
sible in the limited time available, it would be necessary 
momreconcile such factors as “availability of data, timeli- 
ness of data with respect to major changes in the FNWC-PE 
model, sample size, and approach utilized in analysis of the 
Gata. With Ehis in mind, the following data limitations, and 


methods of analysis were established. 


A. DATA 
1. Data Sources 

Data was obtained from: 

(1) NMC hand-analyzed sea-level pressure charts at 
six-hour intervals. (Courtesy of Environmental Prediction 
Research Facility, Monterey, California) .« 

(2) FNWC computer analyzed sea-level pressure charts 
and 500-mb charts at 12-hour intervals. 

(3) FNWC-PE 12-, 24- and 36-hour sea-level and 500-mb 
prognoses, (FNWC products courtesy of FNWC Climatology 
Section) 

2. Geographical Limits 

Geographical limits were established from 20N to 

7SN latitude and from 105E east to 40E longitude. This area 


was then segmented into four smaller geographical areas to 
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facilitate ease in eee collection and evaluation of model 
performance (Figure 1). 
a. Area l 
Area 1 (1O5E-1€C) inc_tudes the astern conti=- 
Ment Of “Acia,..Cfe- lying tsierc ce. 2nd the sestern Pacific. 
Db.) tArea <2 
Area 2 (180-l11'""* mace s tien eastern’ Paci tac 
and the western portion of ‘ic ° erica. 
c. Area 3 
Druead oO CLO GO) one the majority of North 


<_ 


America east of the Rocky “Movntr-ns and the Western Atlantic. 


d. Area 4 
Area 4 (60W-40E) -cluces the central and east- 
erm Atlantic, Greenland, Bhurep. =%4 4 small portion of 


mocthwest Africa. 


a; | lime 
A sample of 6 months fr-3 Secobper 197 L-throvugh tiarch 
1972 was chosen. This period irnciuded one storm season and 


was free from any major changes in the FNWC-PE model. 
4. Cyclone Selection 
In order to screen out systems without significant 
development, only those cyclones with a minimum deepening 
of central pressure of 4 mb in 6 hours, for at least one 
6—-hour period, or 6 mb in 12 hours, for at least one 12-hour 
period, were considered. Those storms which were analyzed 


Bi Sparsemdata apeaswwithout reports confirming or implying 
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the analyzed central pressure were eliminated from considera- 
Elon in the attemst te keep the NMG date on an observational 
basis, thereby reducing the "human element" bias. 
Do wrCyecr one. 1 oes 
For the purpos:.s of this study, systems were catego- 
rized into the foitowins °' -Louc types based on their stage 
of development. 
a. Frontal Wave 
Frontei waves <Se Ehose cyclones nascent yon a 
wave. At this stzige ot development, closed contours may or 
may not be present. 
b. Wave Cyclone 
Wave cyclones are tnose with closed contours 
wiwemein the warm and cold fronts are just beginning to con- 
volute. This stage continues eet the first signs of occlu- 
Sion appear. 
c. Occluding Cyclone 
Occluding cyclones are those in which the cold 
front has pueeaien the warm front. This stage continues 
timer! full occlwsion occurs. 
d. peau Cyclone 
The occluded cyclone is one which no longer has 


mayer rontal structure (i.e. cold low). 


B. APPROACH 
1. Sea-level Pressure 
The NMC hand-analyzed sea-level pressure charts were 


surveyed for cyclones meeting the aforestated criteria. Such 


iS) 





systems were identified by time, date, central pressure and 
evelone type for 0000. 0600, 1200, and 1800 GM2. “For 0000 
and 1200 GMT, latitude and longitude were also recorded. 

The FNWC analysis and the 12, 24 and 36-hour PE sea- 
level prognoses were matched by system with the NMC data. 
For example, a qualifying cyclone which began to deepen at 
0000 GMT and continued to show significant deepening through 
1200 GMT two days iater, a period of 60 hours, would yield 
3 comparisons of the 12-, 24- and 36-hour FNWC-PE pregnoses 
and actual systems, the first spanning the period from Q000 
GMT through 1200 GMT the following day, the second from 
1200 GMT the first day through O000 GMT the third day, and 
the third from 0000 GMT the second day through 1200 GMT the 
Ebdivd ‘day (Figure 2). Comparisons were terminated when 
either filling commenced or significant deepening stopped. 
In those cases where no closed isobars were analyzed or 
forecast, the central pressure was taken as the pressure 
along the trough axis from which the cyclone developed. The 
stages of development could not be determined from the FNWC 
charts; therefore, forecast stages of development were con- 
Sidered to be the same as those at the NMC verifying time. 

After the actual and forecast systems were mated, 
the change in central pressure of each was determined for 
both 12-hourly increments (i.e., 0-12, 12-24, and 24-36 
Recs) ana by verifying time increments (i.e., 0-12, 0-24, 
and 0-36 hcurs) (Figure 3). The forecast changes in central 


pressure were reckoned from the machine analyzed central 
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pressures from which the forecasts were generated. This 
was done in recognition of the fact that machine and hand 
analyses differ, and that the PE forecasts are dependent 
on the machine analyses. 

The mated changes in central pressure were then 
reduced to errors in the FNWC-PE forecasts of deepening rate 
by subtracting the observed from the forecast values. The 
resulting differences indicate, if positive, an underfore- 
cast (i.e. not enough deepening); if negative, an overfore- 
cast; and if zero, agreement between forecast and actual 
change. Those cases where a cyclone was analyzed on the 
NMC chart but not generated by the PE model (i.e. no mini- 
mum in the pressure field) were defined as "not forecast". 

24, osittion 

Position errors were aaa euieiwe d for only the 36- 
hour prognoses in terms of the difference between the 
observed and forecast latitude and longitude coordinates 
of corresponding systems for only the 36-hour prognoses. 
The stage of development was not considered. The resulting 
errors were plotted on scatter diagrams (Figures 16 through 
19) with the actual position being the origin of the grid. 

S.) track 

Due to time limitations, all systems could not be 
inspected for track errors. Consequently, only those storms 
with an actual deepening rate of at least 18 mb over a 36- 


hour period beginning at either 0000 or 1200 GMT were 
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Considered. A further limitation was that the initial, 12-, 
24- and 36-hour positions of both NMC and FNWC systems be 
firmly established; thus, systems with nebulous positions 
(i.e. without closed contours, titose net forecast, and 

those for which data were unavailable due to missing charts) 
were removed from consideraticn. ane rznal sample consisted 
or 12) storms. 

Track error for the above merticned sample was 
established by comparing the mate: MHC and FNWC initial, 
ee) 94~ and 36-hour poSitiome ~piottea, on a single chart. 
Since the NMC and FNWC analyses ¢€® ws@ciai position were not 
necessarily coincident, the plotted tracks were adjusted 
until the initial positions wer coincident. The performance 
of the model in forecasting storu crack was then evaluated 
in terms of whether the forecast position was to the left 
or right of the observed track. 

4. 500-mb Heights 

Verification of 500-mb prognoses was restricted to 

evaluating 36-hour forecasts of Erough depth, motion, and 


sea-level to 500-mb slope for a limited number (40) of 


storms comprising the total sample. 
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Ty RESULTS 


A. EVALUATION OF i2-, Z24- and 3€-HOUR PROGNOSES OVER THE 
TOTAL AREA 


Table 1 compares the peirformance of the 12-, 24- and 36- 


1 


a 


Hour prognoses over the cotas erce without regard to the 
Stages of development. The summary section of Table 1 demon- 
Stmates a tendency of the FKSC-FPiy model to underforecast the 
deepening of cyclonic ©v-teaW wich underforecasts observed 
bimoa.o percent of the cases at 12 hours, 65.0 percentwate 24 
hours and 69.0 percent et 36 kours. The tendency to under- 
forecast development is further shown by Table 2 which lists 
the average forecast error. At i2 hours the average forecast 
G@EGor was an underforercast oo: 3.4 mb , at 24 hours an under- 
Merecast of 4.8 mb, and «=t 36 hours an underforécast of 5.3 
mp. it should be noted, however, that the magnitude of the 
average error, while it did increase, did not increase 
linearly. The rate of increase was from 0 to 3.4 mb during 
Sie f£irst 12 hours, dropped to 1.4 mb during the 12 to 24- 
hour period, and was reduced even further to 0.5 mb during 
ene 12-hour period between 24 and 36 hours. This reduction 
in the rate of increase of the average error implies that 

the magnitude in the underforecast of the 12-hour changes 

of central pressure generated by the PE model was less dur- 


ing the 12-24-hour period than during the initial period and 


was further reduced between 24 and 36 hours. 
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Further analysis of Table 1 reveals that the underfore- 
Cact to-overforecast ratio fell from e273 :ilvin tne i2— ang 
22-hour forecasts to 2..0%i cat 36 hours. Slhis*indieates that 
although the tendency was to underforecast the 12-hour 
changes between the O-12 and 12-24-hour forecasts, the PE 
model at times overforecast the i2-hour change between 24 
and 36 hours to the extent that the net change over 36 hours 
resulted in an overforecast vice an underforecast. 

Table 1 also shows that the number of storms accurately 
forecast (i.e. within + 4 mb) fell from 46.9 percent at 12 
Heowrs to 31.2 percent at 36 hours; indicatine that the over— 
all reliability of the PE model decreased with time. 

Figures 4 through 15 present a further comparison of 
the forecast and observed deepening rates. Observed and 
forecast changes of central ees are plotted along the 
abscissa and ordinate, respectively. Points lying above 
the "FCST=OBS" line represent overforecasts, and points 
lying on the line represent perfect forecasts. The vertical 
distance between a point and the line indicates the magni- 
tude of the error in deepening rate. The nature of these 
Scatter diagrams did not lend itself to a plot of the total 
area due to the number of overlapping points; however, 
viewed collectively, Figures 4 through 15 illustrate again 
the overall tendency of the model to generally underforecast 
development. Also it can be seen that the magnitude of the 
error tends to increase with an increase in the observed 


deepening rate. Tersely stated, the largest errors occur 
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with storms that intensify the most. The fact must not be 
overlooked, however, that on occasion the model does accu- 
rately forecast even the most intense storms. 

Tables "4 through Glililustrate the pertormance of ithe 12>. 
24- and 36-hour prognoses with respect to the stage of devel- 
opment (i.e. storm type). These tables show that the model 
forecast 92.9 percent of all frontal waves. With respect 
to forecast periods, the model did not forecast 7.1 percent 
Goethe frontal “waves at 12 hours, “while alilvof the frontal 
waves were forecast at 24 hours. Of the three frontal waves 
that were observed at 36 hours, two were forecast. Wave 
cyclones were not forecast 9.2 percent of the time by the 
12-hour prognoses, 1.3 percent were not forecast by the 24- 
hour forecast and all waves were forecast at 36 hours. The 
occluding stage, which comprised the majority of the cases 
in all forecast periods, was not forecast 4.7 percent of the 
feme at 12 hours, 1.8 percent at 24 hours and 4.9 percent at 
36 hours. All occluded storms were forecast at 12 and 24 
hours and only 1.4 percent were not forecast at 36 hours. 

With reer to forecast period, the stages of deveiop- 
ment with the greatest and least number of cases underfore- 
cast were, respectively, the occluding storms, 70.6 percent. 
amaseche occluded storms, 4/7.l1 percent, at 12 hours; the 
eceluded storms, 75.9 percent, and the frontal waves, 53.9 
mereent, at 24 hours; and the occluding storms, 70./ permeent, 


and the occluded storms, 55.9 percent, at 36 hours. 
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ables 2 indicates thatthe best. performance with erespeect 
to average error was achieved in forecasting frontal waves 
Weth average underforecasts of 0.3 mb at 22 hours and -2.0) mb 
at 36 hours (based on three storms), and an average overfore- 
east of 0.3 mb at 24 hours. The poorest results were 
tTealized for the occluding stage with i2-, 24- and 36-hour 
average underforecasts of 5.1 mb, 6.4 mb, and 7.5 mb, res- 
pectively. This is consistent with the fact that the great- 
est intensification is usually experienced in the occluding 
stage and that, as discussed earlier, the largest errors 
occur with the most intense storms. 
B. EVALUATION OF 12-, 24- AND 356-HC3R PROGNOSES BY 

CYCLOGENESIS AREA 

Tables 7 through 18 show the performance of the FNWC-PE 
12-, 24- and 36-hour prognoses by cytlogenesis area. Tables 
7 through 9 deal with the model's performance in Area l. 
The 12- and 24-hour forecasts in Area 1 showed performance 
superior to that for the total area with 534.2 and 44.5 per-— 
cent of the cases forecast accurately. In addition, the 
model was superior in the 24-hour forecasts of occluded 
Systems. Only 1 of 182 such cases was not forecast. The 
36-hour forecast prognosticated accurately only 26.6 percent 
of the time, 

Tables 10 through 12 show the model's performance in 
Area 2 to be generally above that for the total area, espe- 


cially in the 24- and 36-hour forecasts where 45.7 and 43.3 
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percent of the cases, respectively, were forecast accurately. 
Table 10 shows that the 12-hour forecasts did not forecast 
l1.7 percent of the waves and &.7 percent of the occluding 
eyclones. An overforecast in 452.9 percent of the cases was 
Observed for the waves in this area. This overforecast and 
an overforecast of SOJU U~cens: of Vine frontalvvaves at v2i2 
hours in Area 3 (Tabie -_, vere the only two occurrences of 
Sf FENLS nature, wrth Co Vee ceuriOnSs. a Mayorley sor 

the cases were underfcrecast for all areas, all time periods, 
and all stages of development. 

As shown by Table 2, rhe PY model achieved its best per- 
formance in Area 2, with respect to average forecast error, 
WEtlmaverarpewunganforecac.s.,o8 \320 > Mb (at. 1 2..nOuUrs «15045 mb 
Sia Gon OwrS TaN acdien Wie. © SOMO LT o:. 

fap les 130i howe nt. vane Eneamec caenance of the model 
im, Area <3:¢> “As tindicated by lable l3 > 947 6 percent ef the 
cases were forecast accurately at 12 hours; however, the 
24- and 36-hour performances fell short of those for the 
total area with 27.1 and 26.4 percent of the cases, respec- 
tively, being forecast accurately. The occluding and 
occluded stages showed significantly larger percentages of 
cases underforecast than those of the total area for all 
forecast periods. 

As shown by Table 2, the average forecast errors for 
Area 3 were underforecasts of 5.4 mb at 12 hours, 7.0 mb 
at 24 hours, and 6.7 mb at 36 hours. These were the largest 


errors observed in any area. 
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Tables 10 through 12 show the performance of the model 
im Area 4. As shown by Table 16, all of the frontal waves 
MOG forecast by the Fe mode: at i2 hours occurred in this 
area, lable i/ indicates that only 2.6 percent of the cases 


were forecast accurately in this area. 


Ge. - LRACK 
As previously described, i21l1 cases were tested for track: 


error with the following results: 


12-HOUR 24-HOUR 36-HOUR 
Pett Ore actual wy ack 24(19.9) 301024. 3) 9212644) 
Along actual track SES (ee 10408.2) WK Os &} 


Riehe. of Vactual track 82(67.7) SL 67..0) 76(62 7 } 
(Parentheses indicate percent; numbers indicate cases 
observed.) 


It should be notec that the decrease in percentage between 
those storms right of actual track between 24 and 36 hours 
indicates that some storms crossed back to the left of the 


actual track between 24 and 36 hours. 


De POSLIION 

Only the 36-hour position error was investigated and 
the results are shown in Figures 16 through 19. While every 
conceivable position error was observed, the majority of 
the forecast positions were to the southwest of the observed 
positions. As shown by Table 3, the average 36-hour posi- 
tion error for the total area was 1.5°S and 2.4°W. It 
EmOulLd pe noted that this is sthewrorecast position v"error. 


Im capplyinge the values from Table 3 to the forecast in order 
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to improve its accuracy, the forecast position should be 
corrected to the north and east. The forecast error being 
to the southwest, since most systems move northeast, indi- 


cates the model is slow in forecasting movement. 


E. 300-mb HEIGHTS 

The limited verification of 500-mb forecasts revealed 
a general tendency for the 36-hour prognoses to underfore- 
cast the depth of troughs, to be slow in the movement of 
Ezeoughs @astward, and to forecast Coo preat.a Slope between 
the sea-level and 500-mb systems. Similar behavior was 
also observed in the NMC-PE model 36-hour forecasts of 
500-mb heights (Tracton, 1973; Fawcett, 1969). 

It should be noted that the intent in this study was 
not a systematic verification of FNWC-PE 500-mb prognoses, 
but rather to point out that there appears to be systematic 
errors in the FNWC-PE prognoses similar to those documented 


for the NMC-PE model. 
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Ven UR XAMPE LES OP UFORE CAS TERRORS 


The sea-level pressure charts appearing in Figures 20 


through 23 present a comparison of the FNWC initial analysis 


for 0000 GMT 19 February 1972 and the 12-, 24- and 36-hour 


PE model forecasts generated therefrom with the correspond- 


ing NMC initial and verifying analyses. This system repre- 


sents one 36-hour segment of major cyclonic development 


along the 


following 


wamies of 


deepening 


00 
a2 
00 
14 


OBS 


DTG 


ORE Bs 2 
OB 2 
AOR EB? 2 
ZOrEB?2 


00 
Nv 
00 
2 


Pasterm :cOast. of the United States (Area 3). othe 
is a tabular summary of the observed and forecast 


central pressure (CP) and the forecast error in 


rate. 
BRVED AND SPOREBCAS! VALUES, OF (CENTRAL PRESSURE 
OBSERVED FORECAST FNWC ANALYZED 
Cr CHANGE CP CHANGE CE 
1002 mb | 999 mb 
982 mb -20 mb 990 mb -9 mb 
976 mb -6 mb 975 mb -15 mb 


974 mb -2 mb 979 mb +4 mb 


FORECAST ERROR IN DEEPENING RATE 


DTG 1Z2-HOUR VERIFYING TIME 
INCREMENTS INCREMENTS 
POPES? 2 0 0 
1OFEB72 se ed Bean mgd a Dae 200 
ZOE) 2 -~9 mb +2 mb 
Z2ZOFEB/2 +O. Mo +8 mb 


(FNWC central pressures are recorded to tenths of millibars. 
Central pressures shown here have been rounded to the near- 
est whole number.) 
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ft can be seen; that) the FNWC “computer—-analyzed central 
pressure was 3 mb lower than that analyzed by NMC. Since 
the data utilized in the FNWC analysis was not plotted, the 
basis for the lower CP cannot be explained; nowever, Figure 
20 shows adequate reports to estatlish the NMC analyzed 
value. At 1200 GMT 19 February 1972, 12 hours after initial 
tame, the FNWC forecast a change in’ CP that was Less than 
ne, observed change (1.6. an Wheres forecast’ of limb), Dur<= 
ing the next 12 hours, the actual! central pressure decreased 
6 mb while the PE model forecast a déepening of 15 mb. This 
established an overforecast of 9 mb for the second 12-hour 
period and a 24-hour net underférecast of 2 mb. During the 
femal J2-hour period, the observed CP decreased further by 
Zab.) but ther PE \forecastran 'inc-ecase of -4- mb. hereby pro-— 
ducing an underforecast of 4 mb omit twelve-hour 
period and a net 36-hour underforecast of 6 mb. Lt should 
be noted that although the 36-hour error in deepening rate 
was 8 mb, the 36-hour forecast in central pressure was only 
5 mb higher than the observed central pressure. This was 
due to the different initial analyses. 

Figure 24 shows the earlier described adjustment made 
to the forecast track to enable track comparison. It can 
be seen from Figure 23 that the forecast system moved to the 
mrent Of the actual track for the first IZ hours, Atter 
Snat it erossed over to the left of the actual track between 


12 and 24 hours and remained there between 24 and 36 hours. 


Ja | 





The 36-hour rioeon of the forecast storm was 2°S and 
6°W of the observed position. 

Figure 25 compares the analyzed 500-mb heights and sea- 
eve | sevelone position for 12200 GMT 20 February, 1972 with 
the 36-hour forecast 500-mb heights and sea-level cyclone 
position verifying at this time. ft can be seen that the 
forecast 500-mb height is not deep enough, the forecast is 
Slow in trough transiaticn, and the slope between the fore- 
cast sea-level system and 500-mb trough is greater than 
that observed. 

It must be realized that few storms demonstrate all of 


' errors discussed in this thesis; however, 


Ene averace 
most storms will exhibit some of the "average" errors. 


This example is no exception. 
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Vi. SUMMARY -AND -GONCLUSIONS 


Bes DESCUSSTON TOF SRESULES 

In terms of deepening of the central pressure, the FNWC- 
PE model does, by-and-large, forecast cyclogenesis to occur 
although the magnitude of the forecast development is 
generally less that that observed. The fact that some cases 
of later stages of development were not forecast is indica- 
Mive that the model -frequentily fails to cproperly recorcnize 
skagerraking (i.e. secondary cyclogenesis at the apex of 
the warm sector). Failure, in some cases, to forecast the 
earlier stages of development (all in Area 4) is likely due 
fo the failure of the model to properly include convective 
processes (Tracton, 1972). The tendency to underforecast 
all stages of development in all three forecast periods (0- 
12, 0-24, 0-36 hours) effected a decrease in the number of 
cases forecast accurately (i.e. within + 4 mb) with forecast 
interval. The rate of increase in the average forecast 
€rror was not linear. This indicated that the underforecast 
orethe I2-hour changes (0-12, 12-24, 24-36 hours) in central 
pressure decreased with forecast interval. 

With respect to the average error in forecast deepening, 
Areas 2 and 4 showed the best results with Area 1 following 
closely behind. The poorest performance was observed in 
Area 3, which also had the lowest number of cases forecast 


accurately. It should be noted that Areas 1 and 3 are 
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regions geographically favored for the development of major 
cyclonic systems (i.e. storms which deepen the most) and as 
was discussed in the Results section, the error in forecast 
deepening rate increased with the magnitude of actual deepen- 
yg cae 

The FNWC-PE model tended to forecast the cyclone track 
Eo the right of the actual track andthe 36-hour forecast 
position was generally south and west of the observed posi- 


tion. 


B. COMPARISON OF FNWC AND NMC-PE MODEL PERFORMANCE 

The approach used by Leary (1971) in investigating the 
performance of the NMC-PE model was somewhat different from 
this study in terms of both the storm sample and the tech- 
niques used in gathering and analyzing data; therefore, 
absolute comparisons cannot be made. Nevertheless, it is 
clear that both models underforecast development; and, while 
the FNWC and NMC-PE 36-hour forecasts compare favorably in 
Area 3, the FNWC-PE model is far superior in Area 2. The 
Bendency for the 36-hour forecast track to lie to the right 
of erat observed, and the 36-hour forecast position errors 
also compare favorably. 

The comparability of the PE models in Area 3 was further 
verified by a comparison of each model's performance for a 
limited sample of storms used in this study (Tracton, 1973). 


Also, when compared to the NMC Limited Area Fine Mesh (LFM) 
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model (Howcraft, 1971), the FNWC-PE model demonstrated 


similar or better performance. 


G...4 CONCLUSIONS 

The Fleet Numerical Weather Central's operational sea- 
level pressure forecasts produced by the five-layer primi- 
tive-equation model do show systematic errors in forecasting 
extratropical cyclogenesis. ‘Ihey -are: 

(i) “An underforecast of deepening rate ina majority 
of cases. 

(2) <A tendency to greatly underforecast the deepening 
rate in the 12-hour prognoses and then underforecast to a 
lesser degree or overforecast subsequent 12-hour changes. 

(3) ak tendency to foreeastthetcyelonme (track torehe 
Mmecit of actual track. 

(4) A tendency to forecast the 36-hour position to the 
South and west of the actual position. 

The average errors observed gave rise to Klopfenstein's 
rule for improving the FNWC-PE 36-hour forecasts of cyclo- 
genesis: 

KLOPFENSTEIN'S RULE 

Deepen the forecast central pressure by 5 mb and move 
the forecast position 2° north and 3° east. 
his is a general rule which can be applied to any stage of 


cyclone development in any area. 
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SUGGESTIONS “POR FURIHER: RESEARCH 
The following topics are suggested for further research: 
(1) Systematic verification of 500-mb prognoses. 


(2) Systematic comparison of FNWC-PE and NMC-PE 
prognoses, 


°(3) Analysis of the source of systematic errors. 


52 





Table I. Total Area (105E-40E) - Comparison of 12-, 24- 
and 36-hour prognoses - parentheses indicate 
percent; numbers indicate cases observed. 





Error in 





deepening U2 hems: 24 hour 36 “hoar 
rate 

se mull e: 

+40 - aS ae, Oa 49 € 09) 
+36 TTC EOnEZ 2 Osa) 
+32 be ae O25) 2020255) 
+28 net 2G) 4 ¢( 0.9) 
+24 376 20220) Ae 3G. ee Oo) ICIS EE S225) 
+20 Gat la) iS? 16 WS Zee ) 
+16 26. A 154.3) CAS ao eo, AUC O24 
+12 36 € 748) yoy C15 5) 57) 
+8 107 €2i.9) One Cee) J 2G) 
+4 3G. “C27 49) oF P2020) 73 a6) 

0 32 4 62-4) pe Geto Cs SiGe oo) 

-4 61. (12.5) 52). WOnay siete ae Gl eG ee 0) 
-8 B32 € 6.4) 345-4720) LDC 9 a) 
=oleZ PG 222 TIMES ee 5 1S: C140) 
~16 lO) age Gael re o> {2 20) 
-20 2 €0C4) 4 (¢€ 0.8) on GO) 
-24 

-28 dee A Oe) 2) CEOS) 
—32 

= 36 

-40 

Not 

Fest 29 ( 5.9) i (Ge ee 6) O36) 
Total 488 484 446 

Summary 

Under- 

forecast 316 (64.8) 334-4069 ..0) 290" (654.0) 
Over- 

forecast 2 (2258) 119 (24.6) PaO ECS Sue) 
Within 

+ 4 mb 229 (46.9) digest O(Csuswrer: } 139 (31.2) 
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fabde- il... “Average amounts of forécast error in mb? 
+ indicates underforecast; 


- indicates overforecast 


O-12 Hours 0-24 Hours 0-36 Hours 
Area 1 +4,.2 +4.0 +5.4 
Area 2 3 0 oS ts 
Ayrea 3 +5.4 +7.0 +6./7 
Area 4 spe eee +5.2 +3.5 
Total Area +3.4 +4.8 +5.3 
Frontal Wave =O Pee -0.3 +2.0 
Wave +2.1 +4,.2 +3.7 
Oeecluding oan + OrrG sae 
Occluded +1.6 +3.0 +1.4 





teapie its, (Average, 36-hour fovecast position exvor an 
terms of degrees latitude and longitude from 


the verifying position. 
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Table IV. Total Area (105E-40E) - Time interval 0-12 

hours - parentheses indicate percent; EDs 
indicate cases observed. 

a ag OES oe in ee 
1 da om elmee Go\ Cyclone Type 


deepening 
ee a ae a ae ES ER at EEE nee ee ee ge 


Fate Frontal 

den m5 Wave Wave Occluding Occluded Combined 

+40 

+36 

+32 

+28 

+24 es eel en ee 37 (0.416) 

+20 6 ( 2.0) cae Ges a 
+16 1: (048) 24. (280) Ae Gees) eee oS) 

+12 jr eres Eo S64) 30% 700...0) 38 ( 7.8) 
+8 6a hae) 26 420.0) (ee Oe i or 2 oo) i Oy ete ch 
+4 14. (33.3) 4732. 3) Feo ig (ee oye ee Ge GO238 wD) IO a 7 eo 

0 2 4 8) i © S34) 19 @i624) 4s C2 34a) SZ) CC tG ae) 

-4 S226) 2 Clee) 2a ee Sul 5. 0) 1645 0. 
-8 > Clio} Bri 46a. 0 des Soe) y age (al Ua ci ee 
-12 di. 2) ae eae Z -C wae? ie ee Gees 
-16 IG. 2%) 2 eG) Zz © 20n7> aS © wae) 
-20 se ies Oe cae 1, Oe 3) 21 107s) 
-24 

-28 

-32 

-36 

-40 

Not 

Fest SC lye Ve ae ee ae Zh (5.98) 
Total 42 130 299 Any 488 

Summary 

Under- 

Moerecast ‘21 (50.0) 76 €58.5) 211. (70.6) B(47.1)316 (64, 8) 

Over- 

Mmorecast 16 (38.1) 35 (26.9) 55 (18,4) SMC Glade 2 24 OD 

Within 

+ 4 mb 2c 59.5} TO (5328) 122) Cas aes 7 ee 2 a oD 
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Table V. Total Area (105E-40E) - Time interval 0-24 hours 
[uparentneces: indieater percent. 


numbers indicate cases observed, 
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iba ble V1. 


Total Area (105E~40E) Time interval 0-36 hours 
—|parentheses indicate, peneent- 
numbers indicate cases observed. 
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Table VII. Cyclogenesis Area 1 (105E-180) Time interval 
O-12 hours - parentheses indicate percent; 


Numbers indicate cases observed. 
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Table VIII. Cyclogenesis Area 1 (105E-180) Time interval 
0-24 hours - parentheses indicate percent; 
numbers indicate cases observed. 
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Table IX. Cyclogenesis Area 1 (105E-180) Time interval 
O-36 hours - parentheses indicate percent; 
numbers indicate cases observed. 
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Table X. Cyclogenesis Area 2 (180-110W) Time interval 0-12 
hours - parentheses indicate percent; numbers 
indicate cases observed. 
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Gab we Ki.  -Cyclorcencesis Area 2. (1280-110) time intvervaleo-74 
hours - parentheses indicate percent; numbers 
indicate cases observed. 
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Table XII. Cyclogenesis Area Z (180-110W) Time interval 0-36 
hours - parentheses indicate percent; numbers 
indicate cases observed. 
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Table XIII. Cyclogenesis Area 3 (110W-60W) Time interval 
O-12 hours - parentheses indicate percent; 
numbers indicate cases observed. 
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Table XIV. Cyclogenesis Area 3 (110W-60W) Time interval 
O-~24 hours - parentheses indicate percent; 
Numbers “indicate= cases Observed. 
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Table XV. Cyclogenesis Area 3 (110W-60W) Time interval 
O-36 hours - parentheses indicate percent; 


numbers vindicate cases observec. 
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Table XVI. Cyclogenesis Area 4 (60W-40E) Time interval 
O-12 hours - parentheses indicate percent; 
numbers indicate cases observed. 
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Table XVIII. Cyclogenesis Area 4 (60W-40E) Time interval 
O-36 hours - parentheses indicate percent; 
numbers indicate cases observed. 
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Figure 2. Determination of comparison periods 


ail 








‘ainssaid [Teiqjusaso 


uf Sasgueyd OF UOTFIONpPST pue uoTAOeT TOS eAep AOF pasn sqewz0q *E Vandy 


< 
m 
a2 
x < 
rm —. 
=z 
7) 





VIEW STSINISOTSAS 


52 





FCST 


20 


10 


10 


20 


30 


40 





50 


Figure 4. Cyclogenesis Area 1 (105E-180) - Time interval 
0-12 hours. Forecast versus observed deepening 


rate ilo 7p. 
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Hecure 5. Cyclogenesis Area 1 (105E-180) - Time interval 
0-24 homrs. Forecast versus observed deepening 
rate in mb. 
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Figure 6. Cyclogenesis Area l (105E-180) - Time interval 
0-36 hours. Forecast versus observed deepening 


rate in mb. 


35 





FCST 


20 
10 
. e 
e e 
. e 
50 40 30 2G) 10° ° : ae 
OF 
¢ 
@ & 
ee e 
oe 
e @0e0 : 
® r é 
® e @ © 
@ e 
® e @ 
eee & Se 
10 
e 
fe) 
Qa 
20 
30 
40 
WY 
e 
Ss - 
50 


Figure 7. Cyclogenesis Area 2 (180-110W) - Time interval 
0-12 hours. Forecast versus observed deepening 
rate in mb. 
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Figure 8. Cyclogenesis Area 2 (180-110W) - Time interval 
0-24 hours. Forecast versus observed deepening 


mate inombd. 
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Figure 9. Cyclogenesis Area 2 (180-110W) - Time interval 
0-36 hours. Forecast versus observed deepening 
rate in mb. 
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Figure 10. Cyclogenesis Area 3 (110W-60W) - Time interval 
0-12 hours. Forecast versus observed deepening 


rate in mb. 
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Figure 11. Cyclogenesis Area 3 (110W-60W) - Time interval 
0-24 hours. Forecast versus observed deepening 
rate in mb. 
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Forecast versus observed deepening 
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Figure eee Cyclogenesis Area 4 (60W-40E) - Time interval 
0-12 hours. Forecast versus observed deepening 
rate in mb. 
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Figure 14. Cyclogenesis Area 4 (60W-40E) - Time interval 
0-24 hours. Forecast versus observed deepening 
rate in mb. 
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Figure 15. Cyclogenesis Area 4 (60W-40E) - Time interval 
0-36 hours. Forecast versus observed deepening 
rate in mb. 
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Cyclogenesis Area 1 (105E-180) - 36-hour position 


error in degrees latitude and longitude. 
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Figure 17. Cyclogenesis Area 2 (180-110E) - 36-hour position 
error in degrees latitude and longitude. 
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Figure 18. Cyclogenesis Area 3 (110W-60W) - 36-hour position 
error in degrees latitude and longitude. : 
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Figure 19. Cyclogenesis Area 4 (60W-40E) - 36-hour position 
error in degrees latitude and longitude. 
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Figure 20. A. NMC Analysis; B.FNWC Analysis OOO0OGMT 19 FEB 72 
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Figure 21. A. NMC Analysis: B. FNWC 12-hr. Forecast 
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Figure 22. A. NMC Analysis: 


5 < 
Sess tke, Ny se Mog 


> 
* 
—— \« tts SMe es Feit on 


B. FNWC 24-hr. Forecast 


71 





0000 GMT 20 FEB 72 





De \ 
RS “Bs 
a j 3 
& .| 
me 
ar | 
ox Ug s 26 ie 
ao, fo . > 
: — x “2g t de 









“a 
Bx tee 
5 Lhasa 
Zp * ¢ nhac’ 
% 32ers 
v. CO eb 
’ e394 ie) ce 
2 | ss, 
ae { ec = 
~ ma Pe |? pommel 
, - el aT, q abt 
% ’ Fi = "she oh - F 
sie Oe: od 
‘ =e as ben 
2 ae 
“ie vee 
\ee any ' EY SB acest 
oo Hg my ' caus. ae 
ve 49014 “Gz 


A 
: AiGey Mest AIS eRe 
6 lo w i i. “4 eS 


v : 

. / 
‘ x at ‘ ° 4 
s . 4 ‘ Ak rv yey wD i a om ° ae LE % Se 4 = 
Mets 2 CU 43{>~2 Ter Is <7 e Bog Ok gan » © ey - (. tee age 





Figure 23. A.NMC Analysis: B. FNWC 36-hr. Forecost 1200GMT 20 FEB 72 
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O: observed track 


X: forecast track 


a: adjusted track 


Figure 24. Adjusted track comparison. 
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Figure 25. A. FNWC analyzed 500-mb heights, position of sea-level low 
eee CD: B. FNWC 36-hour forecast 500-mb heights, 


posifion of sea-level low center Q. 
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